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ABSTRACT 


‘A  Rand  Library  user  survey  was  conducted  in  February  1975.  The  basic 
objective  involved  the  collection  of  sufficient  baseline  data  describing 
user  characteristics,  usage,  and  satisfaction  parameters  to  enable  specific 
library  policy  alternatives  to  be  evaluated. 

The  codebook  gives  a brief  overview  of  the  survey  instrument  design, 
the  data  collection  methodology,  the  data  reduction  process  and  the 
structure  and  distribution  of  the  data,  including  actual  response  frequencies. 
The  preliminary  analysis  is  included  to  provide  the  policy  context  for  the 


survey  and  some  additional  interpretive  information. 
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INTRODUCTION 


In  support  of  its  general  service  monitoring  and  evaluation  policies, 
the  Rand  Library  conducted  a library  user's  evaluation  survey  during 
February  and  March  of  1975.  The  survey  questionnaires  were  distributed 
through  the  interoffice  mail  to  all  Rand  full  time  exempt  employees.  The 
basic  objectives  of  the  survey  involved  the  collection  of  sufficient  baseline 
data  describing  user  characteristics,  usage,  and  satisfaction  parameters  to 
enable  specific  Library  policy  alternatives  to  be  evaluated.  To  determine 
user  reaction  to  present  and  possible  future  policies  and  services,  some 
specific  objectives  were: 

1.  To  measure  the  professional  staff's  usage  and  satisfaction  with 
each  of  the  library's  services  and  collection  components. 

2.  To  evaluate  the  degree  to  which  several  different  policy  changes 
might  affect  the  frequency  of  usage  and  the  level  of  user 
satisfaction  with  specific  services  and  collection  components. 

3.  To  collect  additional  information  on  use  patterns  for  specific 
service  and  collection  components. 

4.  To  relate  data  on  usage  and  satisfaction  parameters  to  user 
characteristics  in  order  to  facilitate  the  evaluation  of  the 
impact  of  future  changes  in  the  composition  of  the  Rand  research 
staff  and  research  direction  on  the  Library's  service  and 
collection  components. 

5.  To  relate  data  on  usage  and  satisfaction  parameters  to  user 
characteristics  in  order  to  evaluate  the  services  supplied  and 
the  collection  utility  for  particular  user  groups  and  categories. 

6.  To  create  baseline  data  for  critical  demand,  usage,  and 
satisfaction  dimensions  for  future  use  in  monitoring  and 
evaluating  library  performance  over  time  and  conducting  trend 
analysis  on  demand  and  usage  patterns. 

The  "Rand  Library  Evaluation  Survey"  operationalized  many  of  these 
concerns.  The  codebook  gives  a brief  overview  of  the  survey  instrument 
design,  the  data  collection  methodology,  the  data  reduction  process  and  the 
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structure  and  distribution  of  the  data,  including  actual  response  frequencies. 
The  preliminary  analysis  is  included  to  provide  the  policy  context  for  the 
survey  and  some  additional  interpretive  information.  The  codebook  section 
functions  as  a basic  reference  document  for  all  of  some  115  variables,  and 
indicates  relevant  cross  tabulations  and  potential  demand  and  usage  models. 
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PRELIMINARY  RESULTS 


This  section  is  intended  to  provide  a brief  overview  of  the  actions 
the  Library  has  taken  in  response  to  preliminary  findings  and  special 
tabulations  analyzing  usage,  satisfaction,  success  in  acquiring  materials, 
and  responses  to  policy  issues. 

The  value  of  the  questionnaire  is  in  the  Library's  ability  to  understand 
and  interpret  the  responses  in  such  a way  as  to  improve  services  and/or 
introduce  new  ones.  While  on  the  whole  the  questionnaire  returns  indicate 
that  the  research  staff  rates  the  Library  as  doing  a good  job,  they  also 
indicate  there  is  room  for  improvement.  Because  a year  has  passed  since 
the  distribution  of  the  questionnaire,  it  is  possible  to  report  on  some 
improvements  introduced  by  the  Library  in  response  to  the  results,  for 
example : 

o Control  of  unclassified  circulation  has  been  transferred  to  the 
Library  and  materials  are  now  charged  directly  to  the  borrower. 

o New  book  purchases  are  ordered  by  telephone  from  a book  dealer 
and  sent  United  Parcel,  reducing  paperwork  and  delay  time. 

o Our  Washington  Office  Library  is  used  to  obtain  Government 
Printing  Office  publications,  increasing  availability  and 
reducing  delay  time. 

o Interlibrary  loan  requests  are  sent  via  teletype;  the  Library 
has  joined  the  Southern  California  Interlibrary  Loan  Network 
to  speed  inter library  loan  service. 

o Improved  claims  procedures  have  been  implemented  to  control 
periodical  subscriptions. 

o The  Tables  of  Contents  service  is  being  accelerated  to  reduce 
unnecessary  routing  of  periodicals  and  increase  everyone's 
access  to  current  issues. 

o Reference  and  literature  search  services  have  been  geared  up 
to  respond  to  the  needs  of  proposal  writers,  including  a fund 
to  purchase  on-line  bibliographic  data  base  searches  when 
required. 
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o Special  subject  catalogs  in  specific  program  areas  (e.g.,  criminal 
justice,  health  sciences,  energy,  intelligence)  have  been  produced 
as  by-products  of  the  Automated  Catalog  System. 

There  are  other  actions  under  consideration  to  improve  service  response, 
e.g.,  a brochure  describing  library  services,  accelerated  ordering  of 
materials  through  increased  use  of  prepayment,  reorganization  of  some  service 
sections,  direct  on-line  access  to  the  CIRC  intelligence  data  base,  and  a 
more  specialized  classified  reference  service. 

The  questionnaire  also  confirmed  as  problem  areas  several  key  library 
services  which  have  long  been  considered  problems  with  seemingly  no  satis- 
factory solutions,  for  example,  the  circulation/ recall  and  periodicals  routing 
services.  These  service  areas  will  remain  problems  because  the  responses 
regarding  alternative  solutions  (mandatory  recall  and/or  loan  periods,  table 
of  contents  instead  of  periodicals  routing)  offer  no  clear  mandate.  The 
problems  remain,  perhaps  better  defined,  certainly  tied  to  the  library  use 
behavior  patterns  of  the  research  staff  and  definitely  in  need  of  more 
analysis  and  work  on  the  part  of  library  management. 

As  was  previously  mentioned,  the  codebook  includes  the  response 
frequencies  for  all  questions.  However,  because  of  the  potential  interest 
in  the  questions  measuring  library  use  and  satisfaction  levels,  success  in 
acquiring  library  materials  and  responses  to  the  policy  issues,  special 
tabulations  of  results  follow,  displayed  in  order  of  importance  or  rank. 

USE 

The  ranking  by  mean  shows  that  the  services  which  are  engaged  in 
location  and  delivery  of  library  materials  are  the  heaviest  used  services, 
e.g.  circulation,  periodicals,  SDI  service,  interlibrary  loan  and  the  Order 
Department.  These  are  followed  by  library  services  which  support  the  location 
and  delivery  services  by  identifying  publications:  card  catalog,  information 

and  reference,  accessions  list,  and  table  of  contents.  (See  Table  1.0). 
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Table  1.0  ^ 

SERVICES  RANKED  BY  MEAN  FREQUENCY  OF  USE 
(Question  8) 


; Use 

Frequencies  by  Percent 

Service 

Mean 

1 

Don ' t Use 

Less  than  once 
every  3 nos; 

at  least  once  At  least  once 

every  3 mos.  a month 

At  least  once 
every  2 weeks 
at  least  once 
a week 

% 

Didn't  Know 
Service  Existed 

A.  Unclassified 
Circulat ion 

3.7 

6.1 

36.0 

24.8 

30.5 

0.6 

S.  Document 
Control 
Center 

3.5 

22.8 

25.3 

15.1 

33.1 

1.5 

F.  Periodical 

Collection 

Service 

3.2 

15.1 

29.6 

21.6 

| 

18.9 

2.5 

G.  SDI  Service 

3.0 

26.1 

24.6 

18.0 

19.6 

8.0 

I.  Interlibrary 
Loan 

2.9 

14.8 

55.0 

15.7 

24.0 

0.3 

J.  Order  Dept. 

2.8 

16.1 

50.4 

19.3 

25.0 

1.5 

K.  Unclassified 

Card  Catalog 

2.8 

18.0 

50.8 

14.8 

13.4 

0.3 

C.  Information 
Service 

2.7 

20.3 

46.0 

16.7 

10.8 

3.1 

D.  Reference 
Servi ce 

2.7 

20.0 

49.2 

15.4 

10.8 

2.2 

M.  Unclassified 
Accessions 
List 

2.6 

39.6 

21.5 

13.5 

17.0 

5.1 

H.  Current  Tables 
of  Contents 

2.5 

33.5 

23.1 

7.6 

13.4 

17.3 

B.  Classified 

Circulation 

2.0 

55.4 

23.5 

8.3 

8.5 

0.9 

E.  Bibliographic 
Literature 
Search 

1.8 

38.6 

50.3 

1.8 

0.9 

4.8 

L.  Classified 

Card  Catalog 

1.8 

56.1 

27.6 

8.0 

2.7 

1.2 

N.  Classified 

Accessions 

List 

1.7 

66. 1 

13.0 

4.1 

6.9 

5.4 

0.  Classified 
Reading 
Room 

\ 

1.6 

65.1 

22.4 

4.5 

2.5 

2.5 

P.  Intelligence 
Facility 

1.6 

61.8 

21.3 

5.1 

2.4 

6.4 

Q.  Maps 

1.6 

54.8 

36.0 

2.5 

2.8 

3.8 

R.  Slavic/ 

Oriental  Lib. 

1.3 

83.1 

6.6 

0.6 

4.6 

2.2  _ 

*The  following  scale  should  be  used  to  interpret  the  table: 

Don't  use 1 

Less  than  once  every  3 months 2 

At  least  once  every  3 months 3 

At  least  once  a month 4 


At  least  once  every  2 weeks 5 

At  least  once  a week.  6 

Didn't  know  service  existed 9 
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AVERAGE  USE  PER  RESEARCHER 

Table  2.0  is  based  on  data  from  question  8 and  shows  that  on  the 
average  the  Rand  researcher  uses  the  Library  10  to  23  times  per  month. 

If  it  is  assumed  that  the  30%  non-respondents  to  the  questionnaire  are 
zero  users  (unlikely)  then  in  the  worst  case  the  lower  bound  average  use 
per  researcher  would  be  7 times  per  month  (.70  x 10  + .30  x 0)  and  the  upper 
bound  would  be  16  (.70  x 23  + .30  x 0).  In  both  cases  (with  or  without  the 
30%  ncn-respondents)  the  results  seem  reasonable  considering  the  nature  of 
library  use,  which  is  that  a use  of  one  service  very  often  results  in  a use 
of  one  or  more  other  services.  For  instance  a search  of  the  card  catalog 
most  often  results  in  the  use  of  circulation  services  which  could  lead  to 
use  of  the  order  or  interlibrary  loan  services,  and  a use  of  reference 
services  usually  leads  to  the  use  of  order,  interlibrary  loan,  periodicals 
and  circulation  services.  Thus  an  average  of  10  or  more  uses  per  month  per 
researcher  can  be  considered  reasonable. 

I 


I 


Service 

Unclassified  Circulation 
Classified  Circulation 
Information  Service 
Reference  Service 
Bibliographic  Literature  Search 
Periodical  Collection  Service 
SDI  Service 

Current  Table  of  Contents 
Interlibrary  Loan 
Order  Department 
Unclassified  Card  Catalog 
Classified  Card  Catalog 
Unclassified  Accessions  List 
Classified  Accessions  List 
Classified  Reading  Room 
Intelligence  Facility 
Maps 

Slavic/Oriental  Library 
Document  Control  Center 


3.9  uses 

1.2 

1.6 

1.5 
.25 

2.7 

2.7 

1.6 

1.8 

1.7 

1.9 
.7 

2.1 

.8 

.4 

.5 

.2 

.3 

4.3 


8.3  uses 
2.6 


Total  Average  Use  = 
Average  Use  Per  Month  = 


The  following  scale  was  used  to  compute  the  average  use  per  researcher  per 
three  months.  The  non-respondents  were  ignored. 


Response 


Questionnaire 

Code 


Lower  Scale 


Don' t use 

Less  than  once  every  3 months 
At  least  once  every  3 months 
At  least  once  a month 
At  least  once  every  2 weeks 
At  least  once  a week 
Didn't  know  service  existed 
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SATISFACTION 

Question  9 measured  the  level  of  satisfaction  with  various  library 
services.  The  ranking  of  satisfaction  by  mean  shows  that  users  generally 
view  the  library  in  a positive  way;  researchers'  reactions  to  library  services 
range  somewhere  between  more  than  neutral  to  satisfied.  The  table  following 
shows  these  results  ranked  by  mean  satisfaction. 

Table  3.0 

SERVICES  RANKED  BY  MEAN  LEVEL  )F  SATISFACTION 


Percent 

Satisfied 

% 

Service 

Mean 

Very  Dissatisfied; 

Neutral ; 

Didn ' t Know 

Dissat isf ied 

Satisfied 

Very  Satisfied 

Service  Existed 

D.  Reference  service 

4.0 

1.8 

54.4 

37.9 

2.5 

I.  Interlibrary  loan 
F.  Periodical  collection 

4.0 

3.4 

63.7 

28.9 

0.6 

service 

3.9 

3.7 

64.3 

26.7 

2.2 

C.  Information  service 
S.  Document  Control 

3.9 

1.2 

62.5 

29.2 

3.1 

Centers 

3.8 

7.3 

58.9 

25.7 

0.3 

J.  Order  Department 
A.  Unclassified 

3.7 

8.8 

67.3 

18.2 

1.5 

circulation 

3.6 

12.8 

68.0 

15.7 

0.6 

G.  SDI  service 
B.  Classified  circula- 

3.6 

5.7 

65.1 

22.7 

7.3 

tion 

3.5 

1.2 

70.5 

11.8 

2.8 

E.  Bibliographic 

literature  search 

3.5 

3.7 

70.5 

14.4 

5.1 

H.  Current  tables  of 

contents 

3.4 

3.1 

67.6 

20.5 

13.5 

K.  Unclassified  card 

catalog 

3.4 

7.5 

76.9 

9.5 

1.2 

M.  Unclassified 

accessions  lists 

3.4 

5.0 

68.2 

13.8 

4.8 

L.  Classified  card 

catalog 

3.3 

2.4 

55.1 

6.6 

2.5 

N.  Classified  accessions 

lists 

3.3 

1.2 

71.5 

11.1 

5.7 

P.  Intelligence  facility 
0.  Classified  Reading 

3.3 

1.8 

70.5 

12.1 

6.4 

Room 

3.2 

4.0 

73.0 

7.2 

3.1 

Q.  Maps 

R.  Slavic/Oriental 

3.2 

6.3 

74.1 

7.9 

4.1 

Library 

3.2 

0.3 

74.4 

4.1 

3.5 

The  scale  to  interpret  the  mean  is 


Very  dissatisfied 1 

Dissatisfied 2 

Neutral 3 

Satisfied 4 

Very  satisfied 5 


3 


WHi 
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It  is  not  unusual  to  see  those  services  which  involve  considerable 
interaction  between  users  and  library  staff  at  the  higher  end  of  the 
satisfaction  scale.  Nor  is  it  surprising  to  note  that  the  heaviest  used 
service  — unclassified  circulation  — received  the  highest  dissatisfaction 
rating.  This  is  one  of  the  areas  identified  by  the  Library  as  a problem 
area. 

AVAILABILITY  OF  MATERIALS 

Availability  of  library  materials  is  very  critical  if  the  Library 
is  to  satisfy  the  informational  needs  of  the  research  staff.  As  Table  4.0 
indicates,  the  mean  level  of  success  is  slightly  better  than  3 on  the  scale 
(often  get  item  in  time)  for  the  most  heavily  used  materials  — periodicals, 
reports,  books.  However,  it  is  clear  there  is  room  for  improvement  in  the 
case  of  books  and  current  periodicals  especially,  where  almost  15%  of  the 
respondents  never  or  seldom  get  their  material  in  time. 

Question  10  measured  the  level  of  success  experienced  in  library  users 
in  acquiring  materials. 

Table  4.0 

COLLECTION  COMPONENTS  RANKED  BY  MEAN* 

LEVEL  OF  SUCCESS  IN  ACQUIRING  LIBRARY  MATERIALS 


Service 

Mean 

% 

1-2 

% 

3-4 

% 

5 

% 

Don't  Use 

E. 

Classified  reports 

3.8 

2.8 

30.6 

6.7 

55.1 

F. 

Maps 

3.8 

2.1 

20.8 

4.8 

65.4 

C. 

Back  issue  of  periodicals 

3.7 

3.8 

61.4 

11.2 

19.0 

G. 

Interlibrary  loan 

3.7 

7.3 

59.0 

12.8 

17.0 

D. 

Unclassified  reports 

3.6 

9.9 

56.9 

10.0 

20.0 

A. 

Books 

3.4 

14.3 

67.3 

6.1 

9.6 

B. 

Current  issue  of  periodical 

3.4 

14.7 

53.8 

8.3 

20.3 

The  scale  to  interpret  the  mean  is: 

1 - Never  get  item  in  time. 

2 - Seldom  get  item  in  time. 

3 - Often  get  item  in  time. 

4 - Usually  get  item  in  time. 

5 - Always  get  item  in  time. 


i 
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POLICY  CHANGES 

Table  5.0  ranks  by  mean  the  responses  to  questions  regarding  policy 
changes  or  new  services.  Most  of  the  responses  indicated  there  would  be 
an  increase  in  use  of  the  Library  if  any  of  these  policies  were  implemented. 

WRITTEN  COMMENTS 

The  questionnaire  was  designed  to  provide  for  written  comments  to 
selected  specific  and  general  open-ended  questions.  Because  of  the  large 
number  and  variety  of  responses  covering  specific  and  broad  topics  including 
circulation,  periodical  routing,  personnel  budget,  physical  layout,  new 
services,  cataloging,  reference  and  order  services,  it  is  difficult  to 
provide  a meaningful  summary.  The  only  clear  signals  were  the  large  number 
of  comments  on  the  circulation/recall  system  (80)  and  the  periodicals 
service  (152),  confirming  these  as  problem  areas. 

A copy  of  the  comments  grouped  by  topic  area  is  available  for  perusal 
in  the  Head  Librarian's  office. 


i 


| 

r 

» 
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Table  5.0  * 

POLICY  CHANCES  RANKED  BY  MEAN 
(Question  20) 


Policy 

Me  an 

% 

No  Effect 

% 

Slightly 

Increase 

% 

Greatly 

Increase 

% Very 

Greatly 

Increase 

J. 

Maintaining  a Reading  Room  with 
current  issues  of  all  periodicals. 

2.2 

24.8 

40.6 

21.2 

11.2 

D. 

Providing  information  immediately 
on  who  has  charged  out  an  item  by 
having  such  information  available 
at  the  Circulation  Desk 

2.1 

26.4 

40.3 

21.5 

8.6 

E. 

Establishing  special  subject  catalogs 
in  specific  areas  of  research  (e.g., 
an  energy  catalog,  an  education 
catalog) . 

2.0 

32.8 

31.8 

22.5 

9.6 

G. 

Maintaining  a subject  area  catalog  of 
machine  readable  data  bases  available 
externally  (government  agencies,  uni- 
versities, and  private  archives). 

2.0 

31.5 

36.1 

21.8 

7.0 

A. 

Increasing  the  dissemination  of 
information  on  existing  library 
resources  and  services. 

2.0 

21.8 

53.5 

15.4 

6.1 

3. 

Establishing  a common  indexing  and 
retrieval  system  for  all  Rand 
publications  and  library  materials. 

2.0 

29.0 

37.0 

22.8 

6.1 

H. 

Maintaining  an  indexing  and  retrieval 
system  for  machine  readable  data 
bases  available  at  Rand  by  subject 
area,  variable  name,  unit  of  analysis, 
and  geographical  level  of  aggregation. 

1.9 

36.1 

33.5 

14.8 

9.6 

F. 

Maintaining  a subject  area  catalog  of 
machine  readable  data  bases  available 
at  Rand. 

1.9 

35.7 

35.4 

17.6 

7.3 

C. 

Adopting  a mandatory  return  policy 
for  materials  in  circulation  when 
requested  by  a second  party. 

1.8 

40.3 

34.8 

13.5 

6.7 

K. 

Adopting  a mandatory  return  policy 
for  all  materials  charged  out  for 
one  year  or  more. 

1.7 

47.0 

28.6 

12.2 

7.6 

I. 

Increasing  access  to  bibliographic 
machine  readable  data  bases 
available  externally. 

1.7 

37.3 

37.3 

13.1 

5.4 

L. 

Establishing  a study  area  in  the 
Library 

1.4 

64.5 

21.2 

7.0 

3.1 

*The  scale  to  interpret  the  mean  is: 

1 - No  effect. 

2 - Slightly  increase  usage. 

3 - Greatly  increase  usage. 

4 - Very  greatly  increase  usage. 
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THE  SURVEY  INSTRUMENT 


The  survey  instrument  was  designed  to  collect  data  for  five  major 
areas : 

1.  Researcher  characteristics 

2.  Degree  of  service  and  collection  usage 

3.  Service  and  collection  evaluation 

4.  Usage  patterns 

5.  Policy  alternatives 

As  conceptualized,  researcher  characteristics  and  library  usage  patterns 
function  as  primary  independent  variable  categories;  and  degree  of  service 
and  collection  usage,  service  and  collection  evaluation,  and  policy  alternatives, 
as  primary  dependent  variable  categories.  Many  variables  within  the  dependent 
categories  however  are  also  independent  variables  in  certain  analytical 
contexts  i.e.,  usage  and  satisfaction  function  as  independent  variables  for 
each  other.  The  distribution  of  questions  within  these  major  areas  or 
categories  is  given  in  Table  6.0,  "Variable  Distribution  and  Item  Listing  by 
Variable  Category."  This  table  also  lists  the  question  number  of  each  item 
within  each  category.  Approximately  50%  of  the  items  requested  required 
the  researcher/ respondent  to  evaluate  a specific  service,  collection,  or 
policy  alternative.  The  remaining  items  provided  a context  for  that 
evaluation  or  supplied  additional  information  on  library  use  patterns. 

Within  the  five  general  categories,  twelve  theoretical  dimensions  were 
covered  by  the  questions: 


1. 

Researcher  training  and 

orientation 

2. 

Research  interests 

3. 

Perceived  value  of  the 

library 

4. 

Information  gathering  habits 

5. 

Awareness/knowledge  of 

library  services 

6. 

Service  usage 

7. 

Collection  usage 

8. 

Service  evaluation 

9. 

Collection  evaluation 

10. 

Library  evaluation 

13 


12.  Policy  alternatives  (circulation,  cataloging,  information, 
collection  components,  library  facility  organization,  and 
respondent  suggestions) . 

Research  findings  for  each  of  these  theoretical  dimensions  exist  within 
the  adoption/diffusion,  communications,  and  information  science  literature 
and  the  above  listing  represents  standard  research  categories  for  evaluating 
service  usage  patterns.  The  distribution  and  listing  of  theoretical  variables 
within  each  dimension  and  the  item  or  items  which  were  utilized  to  operationalize 
the  theoretical  dimension  are  summarized  in  Table  7.0,  "Variable  Distribution 
and  Item  Listing  by  Theoretical  Dimension."  Because  of  limits  on  the  size  of 
the  instrument  which  could  be  realistically  fielded  in  the  Rand  environment, 
all  theoretical  dimensions  of  interest  were  not  sampled,  and  some  dimensions 
were  only  partially  sampled.  Priority  was  placed  on  information  which  was 
not  available  from  other  sources  (i.e.,  library  records).  Only  minimal  data 
on  researcher  characteristics  was  collected. 

Information  on  usage  and  satisfaction  parameters  was  collected  for 
each  of  the  library's  service  and  collection  components.  Table  8.0,  "Variable 
Distribution  and  Item  Listing  by  Library  Service  Category"  and  Table  9.0, 
"Variable  Distribution  and  Item  Listing  by  Library  Collection  Category"  provides 
a listing  of  each  service  and  collection  component  and  the  questions  which 
pertained  to  them.  The  listing  includes  all  usage,  usage  pattern,  evaluation, 
and  policy  items  for  each  of  the  areas. 

The  questions  were  selected  for  inclusion  in  the  survey  on  the  basis  of 
their  relevance  for  policy  analysis  and  the  uniqueness  of  the  information 
collected.  At  the  time  of  the  instrument  design,  the  disposition  of  library 
literature  published  prior  to  1965,  the  usage  of  classified  materials, 
periodical  routing,  the  circulation  system,  and  the  interlibrary  loan  system 
were  all  issues  of  major  concern. 

The  formatting  and  item  presentation  sequence  was  designed  to  minimize 
the  required  response  time  and  take  advantage  of  the  sophisticated  respondent 
population.  A packed  grid  structure  was  utilized  in  presenting  the  precoded 
response  scales  and  often  several  theoretical  dimensions  were  included  within 
the  same  grid.  This  format  was  chosen  in  spite  of  the  potential  for  response 
set  because  it  enabled  the  respondent  to  quickly  evaluate  many  non-salient 


items  in  a comparative  sense  with  a minimum  time  investment.  An  evaluation 
of  the  structure  of  individual  response  patterns  within  grids  revealed 
enough  within  grid  variance  in  responses  to  indicate  an  absence  of  a format 
related  response  set. 

The  average  percent  of  response  omissions  was  high  for  the  question  # 9 
and  #11  grids  (8.1%  and  7.6%)  but  within  the  average  range  of  the  other 
non-grid  questions  for  grid  questions  #8  and  #10  (2.5%  and  3.7%).  The 
pattern  of  omission  seems  more  related  to  the  item  salience  or  respondent 
interest  in  the  item  than  to  problems  created  by  the  grid  format. 

The  average  time  to  complete  the  instrument  was  between  10  and  20 


minutes . 
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Table  7.0 

VARIABLE  DISTRIBUTION  AND  ITEM  LISTING  BY  THEORETICAL  DIMENSION 


Theoretical  Dimension 

Item  Number 
In  Instrument 

Researcher  Training  and  Orientation 

Xj  Department  assignment 

1 

X2  Discipline  orientation 

2 

Xj  Hierarchical  status 

3 

X^  Years/months  at  Rand 

4Y,  4M 

Research  Interests 

X5  Project  RAND 

5A 

Xg  National  Security 

5B 

X7  Domestic 

5C 

Perceived  Value  of  Library 

Xg  Past  research  projects 

6A 

Xy  Current  research  projects 

6B 

X^o  Proposal  writing 

6C 

X 1 1 Writing  for  non-Rand  publication 

6D 

X|2  Professional  maintenance  and  development 

6E 

X^j  Value  score 

6 (£A-E) 

Information  Gathering  Habits 

Xj^  Method  of  Library  Material  Acquisition 

7 

Awareness/Knowledge  of  Library  Services 

X^5  Didn't  know  service  existed 

8 (A-S)£9  responses, 
12  (3  response) 

Service  and  Collection  Usage 

Xi6  Frequency 

8 (A-S),  23  (A-D) 

Xj7  Occurrence 

12,  15,  22,  27,  30 

Service  and  Collection  Evaluation 

X^g  Satisfaction 

9 (A-S),  28 

X^y  Success  of  availability 

10  (A-G),  17 

X2Q  Speed 

11  (A-E) 

Library  Evaluation 

X21  Overall 

32 

X22  Overall  service  and  collection 

9 A-S) 

X23  Overall  collection  availability 

10  (Z  A-G) 

Usage  Patterns 

X24  Circulation  (recall) 

13,  14 

X25  Interlibrary  Loan 

16  (A-E) 

Bibliographic  literature  search 

19  (A-E) 

X27  Classified  Materials 

29 

X29  Intelligence  material  sources 

31  (A-C) 

Policy  Alternatives  - Circulation 

X.,y  Mandatory  return 

20C 

Xjq  Circulation  user  information 

20D 

X3 ] Mandatory  return  after  one  year 

20K 

X32  Prior  1964  access  delay 

21 

Policy  Alternatives  - Cataloging 

X33  Common  library/publications  index 

20B 

X34  Subject  specific  catalogs 

20E 

X35  Machine  readable  data  bases  by  subject  (Rand) 

20F 

X3g  Machine  readable  data  bases  by  subject  (non-Rand) 

20G 

X37  Machine  readable  data  bases  by  multiple  attributes 

2 OH 

Policy  Alternatives  - Information 

X^g  Increased  dissemination  regarding  services 

20A 

Collection  Components 

X Table  of  Contents  rather  than  periodical 

18 

X^q  Access  to  bibliographic  machine  readable  data  bases 

201 

X^3  Alternative  medium  for  prior  to  1964  materials 

24 

X^2  Discard  prior  to  1965  books 

2 5A 

X43  Discard  prior  to  1964  unclassified  reports 

25B 

X44  Discard  prior  to  1965  classified  literature 

25C 

x45  Discard  prior  to  1964  neriodical  literature 

25D 

X46  Periodical  retention 

26 

Library  Facility  Organization 

X47  Study  area 

201. 

X^g  Periodical  Reading  Room 

20J 

Suggestions 

X49  Other 

20M 

X50  What  Library  should  do 

33 
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Table  8.0 

VARIABLE  DISTRIBUTION  AND  ITEM  LISTING  BY  LIBRARY  SERVICE  CATEGORY 


Service 

Item  Number  in  Instrument 

Circulat ion 

8A,  8B* , 9A,  9B* , 10A,  10D,  10E*, 
10F,  12,  13,  14,  20C,  20D , 20K, 
21,  22,  23  (A-D) 

Cataloging 

8K,  8L* , 9K,  9L*,  20B,  20E,  20F, 
20G,  20H 

Accessions  List 

8M,  8N*,  9M,  9N* 

Information  and  Reference  Service 

8C , 8D,  9C , 9D,  11A,  11B,  20A 

Bibliographic  Literature  Search 

8E,  9E,  11C,  19  (A-E) 

Periodical  Collection  Service 

8F,  8H,  9F , 9H,  10B,  10C,  18,  20J, 
2 3D,  24 

SDI  Service 

8G,  9G 

Current  Table  of  Contents  Service 

8H , 9H 

Interlibrary  Loan 

81,  91,  10C:  15,  16  (A-E),  17,  24 

Order  Department 

8J,  9J 

Classified  Reading  Room 

80*,  90*,  11D* , 20L 

Document  Control  Centers 

8S , 9S 

Classified  service.  Also  includes  items  27-31. 


I 

8 

* 


1 


Collection 

Item  Number  in  Instrument 

Books 

10A,  16A,  23A,  25A 

Periodicals 

8F,  8H,  9F,  9H,  10B,  IOC,  16C,  18, 
20J,  23D,  24,  25D,  26 

Reports 

10D,  10E*,  16B,  23B,  23C*,  25B,  25C*, 
27*,  28*,  29*.  30*,  31  (A-C)* 

Maps 

8Q,  9Q,  10F,  16D 

Machine  Readable  Data  Bases 

20F , 20G,  20H,  201 

Intelligence  Materials 

8P* , 9P* , 30*,  31  (A-C)* 

Slavic  and  Oriental  Library  Materials 

8R,  9R,  HE 

Materials  Prior  to  1964 

21,  22,  23  (A-D),  24,  25  (A-D) 

Other 

10G,  16E,  20M 

Classified  collection. 


ORGANIZATION  OF  THE  CODEBOOK 


Each  question  from  the  survey  instrument  was  reproduced  exactly  as 
it  appeared  to  the  respondent,  including  any  precoded  responses.  When  the 
question  had  several  parts  and  multiple  response  values,  it  was  separated 
to  allow  for  a clearer  format  in  matching  question  to  answer.  Questions 
with  multiple  parts  but  a single  response  meaning  were  grouped  together 
rather  than  separated.  Questions  #8  and  9 illustrate  separation,  and 
questions  #16  and  #19  grouping  of  "Circle  all  that  apply."  The  question 
was  repeated  at  the  top  of  each  page  when  there  were  several  parts  requiring 
more  than  one  page. 

MARGINALS 

Immediately  to  the  right  of  each  question  is  a table  of  response 
frequencies  commonly  called  "marginals."  The  marginals  were  produced 
utilizing  the  statistical  package,  DIOGENES  (Data  Base  Field  Frequency 
Generator),  and  the  original  output  format  has  been  utilized  to  display  the 
data  values  in  the  codebook.  With  the  exception  of  questions  #16  and  #19, 
the  format  is  the  same  for  each  table.  The  first  column  labeled  "frequency" 
lists  the  total  records  (cases)  read,  the  total  records  selected,  the  number 
of  unique  data  values,  and  a breakdown  of  responses  by  frequency  of  answer 
to  each  data  value.  The  second  column  shows  the  relative  frequency  of 
each  response  expressed  as  a percentage  of  all  survey  records,  and  the 
third  column  lists  the  data  values  to  which  response  was  made.  The  data 
values  include  both  precoded  responses  and  non-data  responses  (blanks,  zeros, 
and  audit  codes). 

The  marginals  in  this  codebook  describe  the  data  file  in  several 
significant  ways.  First,  they  show  the  incidence  of  item  non-response  for 
each  response  field  by  utilizing  a system  of  zeros,  blanks,  and  audit  codes. 
Secondly,  they  indicate  the  existence  of  any  extreme  values  and  otherwise 
represent  the  distribution  of  responses  among  the  unique  response  values. 

Finally,  for  certain  policy  alternatives  which  do  not  require  a multivariate 
analysis,  the  marginals  indicate  the  relative  tradeoffs  within  use,  satisfaction, 
and  collection  components  without  any  further  analysis  being  necessary. 
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For  each  question  to  which  the  respondent  should  have  responded,  the 

response  field  of  the  machine  readable  survey  record  contains  either  a 

well-defined  response  code,  a blank,  a zero  or  an  audit  code.  If  a question 

should  not  have  been  legitimately  answered  by  the  respondent,  the  field  is 

blank.  This  situation  is  represented  in  the  marginals  by  a frequency  count, 

a percent  of  the  total  responses  value,  and  a " " (blank  space)  under 

the  listing  of  unique  data  values.  A blank  field  reflects  an  inapplicable 

question  which  was  skipped  by  the  respondent  as  a result  of  the  questionnaire 

instructions  (i.e.  "Circle  and  skip  to  Q 32").  In  cases  where  major  skip 

patterns  occur  (i.e.  Q.  #13,  #15,  #22,  #27,  and  #30),  the  frequency  of 

respondents  appearing  in  the  "no  or  not  applicable"  category  should  be  equal 

to  the  frequency  of  "blanks"  in  the  questions  which  were  skipped.  Discrepancies 

in  the  total  number  of  respondents  indicating  no  or  not  applicable  to  the 

skip  or  trigger  question  and  the  number  of  "blanks"  in  the  next  question  were 

caused  by  non-respondents  (missing  data)  on  the  trigger  question  who  then 

may  have  answered  any  of  the  next  questions,  or  respondents  who  after  replying 

no  or  indicating  not  applicable  in  the  trigger  question,  failed  to  follow 

instructions.  When  resolvable,  errors  of  the  latter  were  fixed  during  the 

cleaning  process  by  deleting  the  inappropriate  data  or  fixing  the  trigger 
* 

response.  Note:  in  questions  #4,  5A,  5B,  and  5C,  blanks  signify  missing 

data  since  zero  is  a legitimate  value.  x 

Missing  data  is  generally  indicated  by  a zero  in  the  response  field. 

For  questions  with  this  data  value,  the  respondent  sho^^d  have  replied  but 
for  reasons  of  personal  choice  or  involuntary  error,  dic^^ot.  For  questions 
#4,  5A,  5B,  and  5C,  zero  is  a legitimate  response  indicating  zero  years  or 
percent  and  the  "blank”  indicates  missing  data.  Note:  this  reverses  the 

usual  convention.  In  all  other  cases,  zero  indicates  missing  data. 

Only  the  "I"  audit  code  is  utilized  in  the  file.  An  audit  code  is  a non-data 

% 

code  represented  as  an  alphabetic  character.  The  "I"  indicates  a response 
that  was  unintelligible.  The  respondent  did  respond  to  the  item  but  not  in 
a usable  manner. 


In  resolving  any  given  error,  the  respondent's  answers  to  other 
related  questions  were  carefully  considered. 
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Means  were  computed  by  multiplying  the  number  of  responses  by  the  data 
value  chosen  and  dividing  the  total  by  the  number  of  respondents.  The  mean 
calculation  was  adjusted  if  respondents  indicated  the  service  in  question 
was  not  applicable,  if  they  did  not  know  the  service  existed,  or  if  they  did 
not  respond  at  all  to  the  question  but  should  have  (missing  data).  In  these 
adjustments,  both  the  value  and  the  respondent  were  excluded  from  the 
calculation  of  the  mean. 

The  total  number  of  respondents  for  the  Rand  Library  Evaluation  Survey 
was  310,  a response  rate  of  70.6%.  Users  of  this  codebook  should  note  that 
the  marginals  give  the  distribution  of  response  for  only  the  file  of 
completed  and  returned  questionnaires  (n=310).  These  responses  are  therefore 
unweighted. 


1.  To  what  Kami  department  are  you  currently  assigned? 


3 10  TOTAL  ?tCrJfDS  ftcAC 

310  RECCRCS  SFLfcCT  t D 

10  LNlGlt  C'AT A VALtjrS 

1 .3  00 

5 1*5  01 

5 1.5  03 

2 8 9.0  04 

49  15.7  05 
3b  12.2  07 
18  5. 7 08 

5fc  18.0  05 
23  7.3  10 

fc 7 28.0  11 

.0  ALL  CTHfcRS 


2.  What  is  your  current  departmental 

job  classification? 

FMfcOlcftCY 

1 

LATA 

310 

tctal  9ECSRCS  P c ad 

3 1C 

P6CCR0S  SfLFCTht 

15 

UNICUf  DATA  VALUES 

3 

. 9 

CC 

13 

4.  1 

Cl 

•3 

17.  C 

0) 

, , , 4 

34 

1C.  5 

C4 

LOCISTICS  SPECIALIST  

2 

• 6 

05 

SYSTEMS  INFORMATION  SPECIALIST  .. 

t 

i.e 

07 

OPERATIONS  RESEARCH  SPECIALIST  ... 

b 

2 3 

7.  3 

C8 

PHYSICAL  SCIENTIST  

9 

25 

5.  3 

C9 

PROGRAMMER  ANALYST  

4 1 

13.  1 

10 

3 

• 5 

1 l 

SOCIAL  SCIENTIST  

36 

12.2 

12 

COMPUTER  SCIENTIST  

13 

4.  1 

13 

OTHER  (SPECIFY)  

16 

5.1 

14 

.0 

ALL  CTMERS 

3.  Please  circle  a-  «p 

t V 

9 

CAi'A 

110 

TCl»l  KfCOBCS  KE»C 

110 

MCORCS  St  l EC  T F D 

4 

LMCUf  LATA  VALUES 

1 

• 3 

1 

15 

4.9 

C 

PROGRAM  DIRECTOR/ BETTY 



30 

9. A 

1 

227 

73.  1 

2 

ASSISTANT  PtOFF 

35 

11.2 

3 

RESEARCH  A IDF 

- 

2 

• 6 

4 

.0 

All  TIMERS 

Haw  many  years  and  months  have  you  been  a Rand  employee  or  full-time 
consultant? 


TOTAL  RfcCORCS  R E AC 
RPCCPOS  SELECTEC 


29 

LNIULE  DAT- 

32 

10.  3 

CO 

33 

10.6 

Cl 

A0 

12.8 

02 

14 

4.5 

03 

14 

4.5 

04 

19 

6.  1 

05 

19 

6.  1 

C6 

14 

4.5 

C 7 

14 

4.5 

08 

9 

2.  fc 

C9 

12 

3.  e 

10 

5 

1.5 

11 

5 

1.5 

12 

7 

2.2 

1 3 

7 

2.2 

14 

8 

2.5 

15 

4 

1.2 

16 

9 

2.  e 

1 7 

2 

• 6 

18 

12 

3.e 

19 

5 

1.5 

20 

7 

2.2 

21 

3 

.9 

22 

1 

.3 

23 

5 

1.5 

24 

2 

• 6 

25 

4 

1.2 

26 

2 

• 6 

27 

2 

• 6 

28 

• c 

ALL  CTHERS 

FREOLtKC 7 

1 

310 

TC 

31C 

RH 

12 

LA 

67 

?1.5 

00 

16 

5.  1 

Cl 

17 

5.4 

02 

14 

4.5 

C 3 

23 

7.3 

04 

29 

9.  3 

C5 

49 

15.7 

C6 

21 

6.7 

C7 

29 

9.3 

08 

21 

6.  7 

C 9 

17 

5.4 

1C 

7 

2.2 

il 

• C 

All 

5.  What  percentage  of  your  time  has  been  spent  over  the  last  year  doing 
research  in  each  of  the  following  areas? 


A./B.  NATIONAL  SECURITY  RESEARCH 
C.  DOMESTIC  RESEARCH 


These  distributions 
are  omitted. 


How  important  to  your  work  has  the  Rand  library  been  in  each  of  the 
following  areas?  (Indicate  by  circling  the  average  level  of  importance). 


A.  Past  Research 
Projects  .... 


FHECUNCV 


VERY  UNIMPORTANT 
UN  IMPORTANT 
SOME  IMPORTANCE 
IMPORTANT 
VERY  IMPORTANT 
NOT  APPLICABLE 


310  TOTAL  RECORDS  RE  AO 

310  RECORDS  SELECTED 

7 LN I OLE  OATA  VALUES 

10  3* 1 C 

12  3. « l 

19  6.1  2 

39  19. C 3 
30  29.0  A 
86  27.  6 3 
3*  10.3  3 

*0  ALL  CTHERS 
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7. 

How  do  you  usually  acquire  Information 

and/or  materials  from  the 

library? 

FS  E'JLtfcC  V 

f 

{ AT  * 

310 

TM<1  r.cCCrUS  .-.AC 

3 10 

SPCOfDS  J.-Ltxnc 

6 

• 3 

2*8 

12,8 
6b«  6 

UN  I CUT  C AT  A VALUES 

THROUGH  A SECRETARY 

9 

0 

DIRECTLY  MYSELF 

THROUGH  A RESEARCH  ASSISTANT 

THROUGH  A DOCUMENT  CONTROL  CENTER 

.0 

All  CTHfftS 

IS.  In  general,  how  frequently  do  you  use  each  of  the  following  listed  services? 


A.  Unclassified  circulation  (borrowing 


service) FRECLE6CY  7 CAT  4 


3 10 

TOTAL  RFCDKOS  R'-AU 

310 

FcCCFCS  SILfcCTEC 

8 

UNIQUE  OAT/  VALUES 

5 

1.5 

0 

DON'T  USE  

1 

19 

1 

LESS  THAN  ONCE  EVERY  3 months 

2 

56 

18.  0 

2 

AT  LEAST  ONCE  EVERY  3 MONTHS. 

3 

56 

16.0 

3 

AT  LEAST  ONCE  A MONTH  

4 

77 

?4.e 

4 

AT  LEAST  ONCE  EVERY  2 WEEKS.. 

5 

16.4 

6 

44 

14.  1 

6 

DIDN'T  KNOW  SERVICE  EXISTED  . 

9 

2 

• 6 

S 

• 0 

ALL  CTHFRS 

B.  Classified  circulation  (borrowing 
service) 


3.7 


FREQUENCY  t DATA 


3 10 

TOTAL  RECORDS  REAL 

310 

PECCRCS  SELcCVC 

6 

UNIQUE  DATA  VALUES 

DON'T  USE  

.1 

9 

172 

2.  8 
55.4 

0 

1 

LESS  THAN  ONCE  EVERY  3 MONTHS. 

.2 

36 

11.5 

2 

AT  LEAST  ONCE  EVERY  3 MONTHS. . 

.3 

37 

11.  e 

3 

AT  LEAST  ONCE  A MONTH  

.4 

26 

8.3 

4 

AT  LEAST  ONCE  EVERY  2 WEEKS  . . 

.5 

18 

5.7 

5 

AX  LEAST  ONCE  A WEEK  

.6 

9 

2.8 

6 

DIDN'T  KNOW  SERVICE  EXISTED... 

.9 

3 

• 5 

9 

• 0 

ALL  CTHERS 

C.  Information  service  (directory 

type  questions) 

j FREQUENCY  f DATA 


DON'T  USB 1 

LESS  THAN  ONCE  EVERY  3 MONTHS.. 2 
AT  LEAST  ONCE  EVERY  3 MONTHS  . . 3 

AT  LEAST  ONCE  A MONTH 4 

AT  LEAST  ONCE  EVERY  2 WEEKS  ...S 

AT  LEAST  ONCE  A WEEK 6 

DIDN'T  KNOW  SBRVICE  EXISTED  ...9 
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8.  In  general , how  frequently  do  you  use  each  of  the  following  listed  services 


Reference  service  (quick  subject 
searches) 


DON'T  USE 1 

LESS  THAN  ONCE  EVERY  3 MONTHS.  .2 
AT  LEAST  ONCE  EVERY  3 MONTHS  . . 3 

AT  LEAST  ONCE  A MONTH 4 

AT  LEAST  ONCE  EVERY  2 WEEKS  ...5 

AT  LEAST  ONCE  A WEEK 6 

DIDN'T  KNOW  SERVICE  EXISTED  ...9 
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Bibliographic  literature  search 
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Periodical  collection  service 
(back  issue  article  reproduction). 
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In  general,  how  frequently  do  you  use  each  of  the  following  listed  services?! 


H.  Current  table  of  contents  service 
for  periodicals 
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loan 
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J.  Order 

department 
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UNIQUE  CATA  VALUES 

1 

• 3 I 

9 

2.8  0 

DON'T  USE  

. 1 

16.1 
28.  6 

LESS  THAN  ONCE  EVERY  3 MONTHS 

.2 

F9 

2 

AX  LEAST  ONCE  EVERY  3 MONTHS 
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K.  Unclassified  card 
catalog 
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In  general , how  frequently  do  you  use  each  of  the  following  listed  services? 


Classified  card 
catalog 
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AT  LEAST  ONCE  A MONTH 4 

AT  LEAST  ONCE  EVERY  2 WEEKS  . . 5 ‘ 
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M.  Unclassified  accessions 
list 
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S.  Classified  accessions 
list 


DON'T  USE 1 

LESS  THAN  ONCE  EVERY  3 MONTHS.  .2 
AT  LEAST  ONCE  EVERY  3 MONTHS  . . 3 

AT  LEAST  ONCE  A MONTH 4 

AT  LEAST  ONCE  EVERY  2 WEEKS  ...  5 

AT  LEAST  ONCE  A WEEK 6 
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Classified  Reading 
Room 
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| 8.  In  seneral,  hew  frequently  do  you 

use  each  of  the  following 

listed  services? 
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Slavic  and  Oriental 
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S.  Document  Control 

Centers 
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9.  How  satisfied  are  you  with  the  library's  performance  to  date  in  providing  each  of  the  following  listed  services7 


E.  Bibliographic  literature  searches 

(extensive  subject  searches) FP'Ol  rv  * , -»  , 


VERY  DISSATISFIED 1 

DISSATISFIED 2 

NEUTRAL... 3 

SATISFIED 4 

VERY  SATISFIED 5 

DIDN'T  KNOW  ,>LKVICE  EXISTED... 9 
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SDI  service  (routing  of  articles 
of  Interest) 


H.  Current  table  of  contents  service 
for  periodicals 
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issue  article  reproduction) 
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VERY  SATISFIED 5 
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9.  How  satisfied  are  you  with  the  library's  performance  to  date  in  providing  each  of  the  following  listed  services? 


Inter  1 ibrary 
loan 
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J.  Order 
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K.  Unclassified  card 
catalog 
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10.  A measure  ol  document  Kic.uum  gOCvlCM  !■  (b*  IVSila  • ' I ■ • 

an  item  upon  request.  What  level  of  su.  ■ ra>  hive  . i «xpcrlu  *4  La  ■ iuIi  Log 
each  of  the  following  materials? 
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ti . Current  Issue  ot 

periodicals 
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C.  Back  Issue  of 
periodica  Is. . 
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A measure  of  document  locaciou  services  is  the  availability  and  delivery  oi 
an  item  upon  request.  What  level  of  success  have  you  experienced  in  acquiring 
each  of  the  following  materials? 


Interllbrarv  loan 

items 


TCTAl  f-fcCOKDS  -UAL 
Kf  CORDS  SflF-CTf  ' 
UNIQUE  DATA  VAl  I 'I  S 


NEVER  GET  ITEM  IN  TIMF.  . 
SELDOM  GET  ITEM  IN  TIMF. 
OFTEN  GET  ITEM  IN  TIMF... 
USUALLY  GET  ITEM  IN  TIME. 
ALWAYS  GET  ITEM  IN  TIME.. 
DON'T  USE  SERVICE 


Unc lassif ied 
reports 

F of  LLff  C Y 

i 

lATA 

310 

total  •« 

l C 0 1*  l>S  ^ Aj 

3 1C 

- 

>fLfCr' 

7 

IN1UL. 

' *-tm  VALU-  S 

9 

2.  E 

0 

NEVER  GET  ITEM  IN  TIME. . . 

. .1 

l 

• 3 

1 

SELDOM  GET  ITEM  IN  TIME.., 

..2 

30 

9.6 

2 

OFTEN  GET  ITEM  IN  TIME... 

. .3 

5 7 

1H.3 

3 

USUALLY  GET  ITEM  IN  TIMF:., 

. .4 

120 

32.6 

4 

ALWAYS  GET  ITEM  IN  TIME.. 

..5 

:•  l 

10.  C 

5 

DON'T  USE  SERVICE 

. .9 

tz 

20.  C 

S 

.0 

ALL  CTH 

£ RS 

reports 

FT  f CLtNC  Y 

t 

DATA 

310 

TCI  A L ruCOLS  RtAl 

2 10 

FFCOPCS  SELECTcf. 

6 

UN!  Ct:  f;AT  A VALU-  S 

14 

4.  S 

C 

SELDOM  GET  ITEM  IN  TIME. . 

.2 

S 

2 - f 

2 

OFTEN  GET  ITEM  IN  TIME... 

.3 

32 

10.  i 

3 

USUALLY  GET  ITEM  IN  TIME. 

.4 

t 3 

20.  3 

4 

ALWAYS  GET  ITEM  IN  TIME.. 

.5 

2 1 

6.  7 

b 

DON’T  USE  SERVICE 

.9 

1 71 

bb.  1 

9 

.0 

ALL  C THE 

FRcCLFNC Y 

t 

uAT  A 

310 

TOTAL  FlC3.U)S  *FAL 

2 10 

RL'CCRCS  ScLECTt-r 

7 

LNIQUL  LATA  VAl  U<  S 

20 

6.4 

0 

NEVER  GET  ITF21  IN 

time; 

.1 

1 

• 2 

1 

SELDOM  GET  ITEM  IN 

time:.  . . 

.2 

6 

Imt 

2 

OFTEN  GET  ITEM  IN 

TIME 

.3 

2 L 

6.7 

3 

USUALLY  GET  ITEM  IN  TIME. . 

.4 

44 

14.  1 

4 

ALWAYS  GET  ITEM  IN 

TIME. . . 

.5 

lb 

4.  £ 

5 

DON’T  USF.  SERVICE. 

.9 

2C3 

6b.  4 

9 

• 0 

All  CT  HE  RS 

M 


(quick  subject  searches) 


C.  Bibliographic  Literature 

Services  (extensive  subject 


searches) 


• • 


11.  A measure  of  reference 

services  is  the  speed  of  response  to  a request 

for  inf ormat ion 

I or  reference.  What  speed  of  response  have  you  most  often  experienced 

for  each  of 

the  following  services? 

E.  Slavic  and  Oriental 

Library. . 

f NfCL^NC  V 

f 

DAT  A 

310 

total  kfcCOkDS  r-ao 

310 

rcc°«:n5  $r.i£CTt r 

t 

IMClt  LATA  VALUES 

26 

P.3 

c 

| WITHIN  ONE  MONTH... 

2 

I 

, 3 

2 

WITHIN  TWO  WEEKS... 

3 

4 

1.2 

3 

WITHIN  ONE  WEEK 

4 

4 

1.  2 

4 

SAME  OR  NEXT  DAY... 

s 

14 

4.5 

K 

DON'T  USE  SERVICE.. 

9 

2f  1 

H4.  1 

C 

- 

• c 

All  fTHFPS 

MEAN 

4.3 

1 

12  Do  vou  usually  utilize  the  Circulation  Services'  recall^ 

process  if  the  library 

item  you  require  Is  checked  out? 

F^cWUtNCY 

? 

OAT  A 

310 

7 1 7 A l - -eCJiNl'S  P C AC 

310 

PrfCKLS  S c L 5 C T . . 2 

4 

IN! CL"  OAT  4 VA^UcS 

5 

1.5 

C 

17a 

65.7 

1 

NO.  - 2 

67 

23.0 

2 

DIDN'T  KNOW  SERVICE  EXISTED..  3 

45 

14.5 

3 

• 0 

ALL  TTHcRS 

13.  Has  an  item  which  you  have  borrowed  ever  been  recalled? 


NO. . . (Circle  and  skip  to  0.15T--  1 

YES ...(Circle  and  continue  with  Q*14) 2 


210  TCTAL  KtC'hxCS  •■'!*!- 

’10  FfCHkCS  SHECTc.1 

3 LNlCi  : CM  4 VALU-S 

4 1.2  C 
7C  22. 5 1 

236  76.1  2 

.0  All  lIHERS 


r >■ 


310 

31U 

( 

KT'L  AC 

M . LfoTt 

UMrU-  c Y1  A VAl  U.  S 

khi  EASE  I 1 EM  1 MMFU 1 A 1 ELY 

. 1 

4 

l US 

i • . 
‘0.0 

C 

1 

RELEASE  ITEM  WITHIN  A WEEK.. 

. 2 

l .( 

NOT  RELEASE  1 1 EM  AND  Kt.fjUES'l 

ANOIIH-K  COPY  HF  Obi  AlSb.lt . 

3 

.s 

1 

OIHIK  (SPECIFY) 

L 7 

• .4 

t 

LONOKE  THE  REQUEST 

. .4  - 

.0 

31  L l TH-  f< 

Do  you 

use  the 

Interllbrary 

Loan 

Servl 

NO.  . . 

(Circle 

and  skip  to  (). 

18)  . 

YES.  . 

. (Circle 

and  continue 

with 

<M6) 

3 10 

Tcm  • 

t C r :.S  -l4L 

? 10 

FI  r -r. 

rlLCTl 

3 

1.5 

U>  I CL 
C 

' .T  » VAL  J PS 

57 

U. 

1 

24e 

RO.O 

2 

What  type  of  material  do  you  usually  request  on  Interllbrary  loan: 
(Circle  all  that  apply) 


A.  BOOKS 1 

B.  REPORTS 2 

C.  PERIODICAL  LITERATURE. .. 3 

D.  HAPS 4 

E.  OTHER**  (SPECIFY) 5 


206  66.4  I 

125  40.3  2 

153  49.3  3 

3 .9  4 

2 .6  5 

.0  ALL  OTHERS 


17.  To  what  degree  Is  the  Interlibrary  Loan  Service  able  to  fill  your  requests? 


ALWAYS 1 

USUALLY 2 

OFTEN 3 

SELDOM 4 

NEVER 5 


310  TC1AL  kCCQKLS  '<EAC 

310  ppcorcs  select;  c 

6 UNIQUE  CAT  A VAcUES 

6 2 20. C 
43  13.6  1 
172  55.4  2 
26  8.3  3 

6 1.  8 4 

l .35 

.0  ALL  CTHERS 


18. 

Would  you  be  willing 

to  receive  a 

Table  of  Contents  In 

place 

of  the  current  lassue  of 

a periodical  In  those 

cases  where 

you  and  at  least  one 

other 

person  are  on  the  routing 

list? 

FREQUENCY 

t 

OAI  A 

310 

TOTAL  RECORDS  HI  AC 

3 10 

RECORDS  SEUECTfL 

6 

UNIQUE  DATA  VAUUtS 

12 

3.  e 

0 

DEFINITELY  YES 

52 

16.  7 

YES 

MAYBE 

60 

19.  3 

3 

NO 

78 

25.  1 

DEFINITELY  NO 

26 

6.  3 

5 

• 0 

AIL  CTMERS 

In  general,  what  Is  your  ultimate  purpose  In  requesting  a 
(Circle  all  that  apply) 


YES  Rl> 
SPONSES 


NEVER  REQUEST 

A PROPOSAL 

FINAL  BIBLIOGRAPHY 
GENERAL  BACKGROUND. 
OTHER  (SPECIFY) 


,0  ALL  OTHERS 


To  what  degree  would  each  of  the  following  policy  changes  probably  Increase 
your  overall  Rand  library  usage? 


: 

SLIGHTLY  INCREASE 

GREATLY  INCREASE 

VERY  GREATLY  INCREASE, 


Establishing  i common 
indexing  and  retrieval  system 
for  all  Rand  publi  it  ions  and 
library  materials. 


NO  EFFECT 

SLIGHTLY  INCREASE.... 

GREATLY  INCREASE 

VERY  GREATLY  INCREASE, 


NO  EFFECT 

SLIGHTLY  INCREASE 

GREATLY  INCREASE 

VERY  GREATLY  INCREASE, 


r 


20.  To  what  degree  would  each  of  the  following  policy  changes  probably  Increase 
your  overall  Rand  library  usage? 


D.  Providing  informal  ton 

Immediately  on  who  has  charged 
out  an  Item  by  having  such 
Information  available  at  the 
Circulation  Desk. 


NO  EFFECT 1 

SLIGHTLY  INCREASE 2 

GREATLY  INCREASE 3 

VERY  GREATLY  INCREASE... 4 


2 10 

310  g 

* l 

9 ?.S  C 

t2  26.4  1 
12b  40.3  ? 
67  21.5  3 


’TjTal  ; . c ac 

f-CtFL.  arlfCT  r 
l*!CU‘  i.  ST  t VALUcS 


b.6  4 

.0  AH  L I HfRS 


Establishing  speclaj  subject 
catalogs  In  specific  areas 
of  research  (e.g.,  an  energy 
catalog,  an  educational 
catalog) . 


NO  EFFECT 1 

SLIGHTLY  INCREASE 2 

GREATLY  INCREASE 3 

VERY  GREATLY  INCREASE... 4 


310  TOTAL  RECORDS  KlAO 

210  RECCES  SllfCTcL 

5 LM  3LE  Of  TA  VALUt  S 

9 2.e  0 

102  3 2.6  l 

99  31. f ? 

70  3 

30  9.6  4 

• C ALL  fTHt_i*r> 


F.  Maintaining  a subject  area 
catalog  of  machine  readable 
data  bases  available  at  Rand. 


NO  EFFECT 1 

SLIGHTLY  INCREASE 2 

GREATLY  INCREASE 3 

VERY  GREATLY  INCREASE... 4 


G.  Maintaining  a subject  area 
catalog  of  machine  readable 
data  bases  available  externally 
(government  agencies,  univer- 
sities, and  private  archives). 


310  TCTAL  Pf COEDS  F AD 

210  FECCF0S  SElcCTt  " 

5 IN  IULt  ^.TA  VALUl  S 

11  3.5  0 

111  35.7  1 
110  35.4  2 
55  17.6  3 
23  7.3  4 

.0  ALL  C THE  RS 


MEAN  - 1.9 


NO  EFFECT 1 

SLIGHTLY  INCREASE 2 

GREATLY  INCREASE 3 

VERY  GREATLY  INCREASE... 4 


310  TOTAL  RECORDS  P t AC 

210  recorcs  sticcTtc 

5 IN  I OUt  DATA  VALUES 

10  3.  I 0 

S 8 31.5  1 
112  36.1  2 
68  21.8  3 
22  7.C  4 

•0  ALL  OTHERS 


MEAN 


iaO. 


20.  To  wild t degree  would  each  of  the  following 
your  overall  Rand  library  usage? 


hanges  probably  Increase 


Lst  abl  1 sh liig 
library. 


• ludy  area  in  the 


NO  EFFECT 1 

SLIGHTLY  INCREASE 2 

GREATLY  INCREASE } 

VERY  GREATLY  INCREASE... 


* 1 C ’llAl 

MO  e I 

•>  Oft  f , u ! I T * 

K ( 

20C  o«..*  1 

2 Im  £ / 

_ -v  /.r  ’ 

10  >.  i * 

• l 'Ll  U- 


1 ’t  tier  sugg.  .1  I II 


1 r . I »-  and  loutlnue  with  Q.21). 
1 f 'Circle  and  e labor  at e below) . . . 


3 10  1 1 ML  ' f 

310  * 1 f > ' l Co* 

C*  ! CU  * T A V U 1 
■»  ?•  - 0 
_23i  7C  • 1 1 
_ 6-1  >l.a  2 

f AIL  CTH1  ws 


21  1.  geeral. 

win 

• i w<*>.  i ' hr  tin  max  t mum  m 

res.*,  delay  you  <ould  tolerate  If 

mater  1 a l » y 

. .tied  pi  1 • t ■ 1 9b  • were  p 

ut  In  storage' 

E>«  :CLf  NuY 

7 

^ AT  A 

3 10 

TOTAL  k*  UilKDS  Kr  AC 

310 

. 1 cCT  *r  c 

(■ 

LMCIF  LATA  VAco  S 

£ 0 

b.< • 

0 

1 

THREE  DAY  • 

2 

30.  ft 

2 

FIVE  DAY  *• . 

SP 

1P.E 

3 

iKVKN  LAY  ‘ 

. . . H 

A 1 

13.  1 

A 

run 

50 

lft.1 

5 

• C 

All  CTHbFS 

MEAN 

“ .2. 

12.  Do  \ 

,,..i  .itlllze  Rand  library  literature  that  Is  IQ  years  or 

older  1 

n your  research? 

* F ECUtNCY 

1 

DATA 

310 

TOTAL  OtCOhOS  f l A0 

3 10 

c-ICORCS  UltCTcl 

3 

LMCUt  DATA  VALUIS 

5 

1.5 

0 

NO . . 

75 

24.  1 

1 

YES. 

(Circle  and  continue  with  0.71) 

2 30 

7A.1 

2 

• C 

ALL  CTMFPS 

How  ot  ten  Jo  you  use  each  ot  the  followliiK  types  ut  library  lU.-r.Uure  published 
prior  to  19b5' 


1 lteralure.  ■ . • 

F»*rccc‘.cv 

t 

3 10 

T H 

AL  c <. 

310 

l 

■'  r T j 

7 

If  ] 

.1. 

6 4 

20.6 

6 

1.8 

0 

NEVER 

. 1 

ONCE  A Y EAR.  . . 

.2 

38 

12.2 

2 

ONCE  EVERY  SIX 

MONTHS... 

. 3 

PI 

26. 1 

ONCE  A MONTH.. 

.4 

16.  7 

4 

MORE  THAN  ONCE 

A MONTH.. 

-S 

60 

16.  1 

5 

• 0 

ALt 

L TMfc  E 

Unclasslr led  report 
lileratufe 


NEVER 1 . 

ONCE  A YEAR 2 

ONCE  EVERY  SIX  MONTHS 3 

ONCE  A MONTH 4 

MORE  THAN  ONCE  A MONTH... 5 


3 l 0 TcTAL  -ffUlu'S  H 

2 ic  «> « r l. i- r o Setter..: 

7 LNIOIF  CAT  A V M_U“'S 

64  20.6 
13  4.  1 C 

33  10. t 1 
*?  16.7  2 
79  26.4  3 
44  14.  1 4 
?S  h.O  5 

.0  Alt  CTHc^S 


Classified  report 
literature 


NEVER 1 

ONCE  A YEAR 2 

ONCE  EVERY  SIX  MONTHS.... 3 . 

ONCE  A MONTH 4 

MORE  THAN  ONCE  A MONTH... 5 


310  TCTAL  ACCORDS  r^AC 

310  PEC  ’ R L S iFltLTct) 

7 IMtU  CAT  A VMUcS 

20.4 

19  t • 1 C 
1113  30.0  l 
32  10.3  2 
43  13. F 3 
16  6. 1 4 

14  4.5  *» 

.0  ALL  L THE P S 


Periodical 
1 1 terature . 


NEVER 1 . 

ONCE  A YEAR 2 . 

ONCE  EVERY  SIX  MONTHS.... 3 . 

ONCE  A MONTH 4 

MORE  THAN  ONCE  A MONTH... 5 . 


3 10  TOTAL  RELOADS  A E Af 

310  BLCCPCS  SHFCT6C 

7 CM  CUC  LATA  VALUES 

l 4 20.6 

4 1.2  0 

30  9.6  1 

4 2 13.*  2 
71  22.8  3 
51  16.4  4 
48  16.4  5 

.0  ALt  CTMtRS 


U.  If  It  became  necessary  to  discard  pre-  1 9t>4  periodical  runs  because  of  space 
requirements,  would  you  prefer  that  the  library: 

(Circle  one) 

1 <.L‘.N  -Y  1 CAT  A 


Had  a microform  copy  of  the  periodical  1 

Provided  interlibrary  loan  photodupl Icat Ion  service....  2 
Other  (specify) 3 


J 10 

310 

4 

61 

4 

SI 

122 

32 


I'.'T  '-I  i i'  - PS  . £ 
Pcf:.f  > $.  l ■ lT  ^ 

tN!  wit  IMA  VALLk  S 

l‘/.6 
1.?  0 

29.3  1 
39.?  2 
10. i 3 

• 0 ALL  f.  T H E P :> 


MEAN  - 1.7 


25.  The  information  science  lileratute  indicates  that  90*  of  library  requests 
are  ror  materials  published  in  the  last  ten  years.  Based  on  this  and 
considering  your  own  information  needs,  what  would  be  the  effect  on  your 
research  effort  if  the  library  was  to  discard  Its  collection  of  materials 
published  prior  to  19b5? 


A .  Book 


literature 

FREQUENCY 

! 

LATA 

310 

TOTAL  kcLaaOS  *EAD 

3 1 C 

RECCRCS  ScLICTcC 

5 

UNIQUE  CAT  A VALUES 

9 

?.e 

0 

NO  EFFECT 

..1 

12 

16.  7 

1 

SLIGHT  EFFECT 

. .2  _ 

l 14 

36.  7 

2 

SIGNIFICANT  EFFECT.. 

- . 3 

104 

33.5 

3 

DISASTROUS  EFFECT... 

. . A 

?1 

10. 0 

4 

• 0 

ALL  CTHfRS 

MEAN 

- 2, 

B.  Unclassified  report 
literature 


FREQUENCY 

« 

OAT; 

310 

TOTAL  k t LOROS  R t AD 

310 

TFCCRCS  SELECTFL 

5 

UNIQUE  0ATA  VALUES 

11 

3.5 

0 

NO  EFFECT 

..1 

E 3 

26.7 

1 

SLIGHT  EFFECT 

. .2 

146 

47.0 

2 

SIGNIFICANT  EFFECT.. 

.3 

56 

18.0 

2 

DISASTROUS  EFFECT... 

14 

4.5 

4 

• 0 

A L l CTHfcRS 

MEAN  * jo 


C.  Classified  report 
literature 


FPECLENCY 

t CATA 

310 

TOTAL  RECORDS  READ 

310 

PFCCP0S  SELECTED 

5 

UNIQUE  OAT  A VALUES 

18 

5.7  0 

NO  EFFECT 

. .1 

172  55.4 

1 

SLICHT  EFFECT 

- 2 

68  21-8 

2 

SIGNIFICANT  EFFECT.. 

. 3 

36  11.5 

3 

DISASTROUS  EFFECT... 

L 

16  4-1 

4 

• 0 

ALL  CTHERS 

MEAN  » 1, 

.5 

The  information  sclen.e  lilec.itute  1 i..l  t.  .it  cs  that  VOX  of  library  reque&l 
are  tor  materials  published  In  the  last  ten  years.  Baaed  on  this  and 
considering  your  own  Inf orru.it  Ion  ueedb , what  would  b«-  the  effect  on  youi 
research  effort  if  the  library  was  to  discard  Its  collect  Ion  of  material 
published  prior  to  19t>V.’ 


D.  Her lod leal 
literature. 


NO  EFFECT 1 

SLIGHT  EFFECT 2 

SIGNIFICANT  EFFECT. . . 3 
DISASTROUS  EFFECT.... 4 


it.  T M r 

F f C ^ L S 

lm  cl: 

D 

1 


26.  If  a cost  analysis  showed  that  it  would  be  more  cost  effective  to  obtain  a 

photocopy  of  a periodical  article  through  lnterllbrary  loan  rather  than 
retention  of  the  periodical,  would  you  consider  this  the  primary  criterion 
on  which  to  determine  the  periodical  retention  policy  of  the  library? 

FREQUENCY 

1 

DATA 

310 

T r T * L . CO*r  S <£AC 

510 

CbCS  jt LECTr  ~ 

3 

IV I cut  Lata  V A ( U S 

20 

6.4 

c 

185 

59.  t 

1 

105 

11.  P 

2 

• c 

ALL  CTHrhS 

-7.  Do  you  use  classified  materials? 

FREQUENCY 

T 

DATA 

— 

— — 

310 

TOTAL  RELOADS  READ 

310 

P'-lCGCS  SELECTCC 

3 

LMQUc  CATA  VALUES 

12 

3.e 

0 

NO... (Circle  and  skip  to  Q.32) 

U 3 

52.5 

1 

YES ... (Circle  and  continue  with  Q.28) 

2 

135 

43.5 

2 

.0 

ALL  CTHERS 

28.  Arc*  your  classified  Information  needs  satisfactorily  met  by  the  library? 


TOTAL  RECORDS  R t AD 
PFCCRCS  SriFCTfcG 
UNICUE  DATA  VALUES 


NO. ..  (Circle  and  elaborate  below) 1_ 

YES ...  (Circle  and  continue  with  Q.29) 2_ 


29.  Roughly  what  percentage  of  your  Information  needs  require  claaaiffed 
materials? 


FJ-i.gL.NCV 


TUT AL  PiCJkLS  & 'AC 
F c C C R C > S6LECTcO 
INlCLt  DATA  VALUES 


3 

.5 

000 

9 

1.2 

002 

1 

• 3 

002 

1A 

A. 5 

005 

15 

A. 8 

010 

c 

1.  5 

01? 

1 

• 3 

ou 

10 

3.1 

020 

11 

3.5 

02  5 

1 

. 3 

o?e 

s 

?.e 

030 

1 

• 2 

03A 

1 

• 3 

035 

l 

.3 

03? 

2 

.6 

CAO 

22 

7 • C 

050 

b 

1.5 

06  0 

2 

• e 

06  5 

1 

• 2 

06  7 

2 

• 6 

070 

10 

3.1 

075 

7 

2.2 

080 

7 

?.  2 

090 

1 

.3 

09? 

2 

.6 

100 

• C 

AH  CTHtPS 

30. 

Do  you  use  Intelligence  materials? 

FFcCLcNCV 

i 

LATA 

310 

TCTAL  PtCOfXS  READ 

3 1C 

RUTFCS  ScLtC  TG  0 

A 

INIQIE  DATA  VALUtS 

l 7? 

55. A 

1 

.3 

0 

No. ..  (Circle  and  skip  to  3 2)..,. 

) 

? 2 

16.  7 

1 

YF.S.  ..  (Circle  and  continue  with  <2.31) 

£5 

27.2 

2 

• 0 

ALL  CTHFftS 

What  percentage  ot  your  Intelligence  information  needs  are  obtained  from  each 
of  the  following  sources? 


A.  CLASSIFIED  LIBRARY 


MEAN  * AO.  32 


3 10 
3 10 
19 

229  1 2.2 


ICTAt  -ttCOPOS  KlAO 
Ft  CuPCS  SfclfcLTtC 
LF  fCL£  t'A  f A VAlUfcS 


19  A. 5 00C 
1 .3  00? 


6 l.P  010 

6 UR  0?0 

3 .5  0 2? 

t l.P  030 
l .10a3 

1 .3  035 

1 / K.A  050 

? 1.5  Ct  C 

< rnt  070 
3 .9  075 

7 .’.2  0PC 

3 .«  090 

2 .*  09*- 

9 U?  100 

• o au  ctm: as 


‘.V'iu  - 


Jl(  What  percentage  ot  your  Intelligence  information  needs  are  obtained  from  each 
ol  the  tollowlug  sources'; 


b.  INTELLIGENCE  FACILITY 


factory  t 


i,  AT  A 


310 

TC T AL  • FCJFOS  2.  if  Al, 

3 1 C 

FFCOFC  > i.LtCTr  L 

IS 

IMCl/-  b •'»  T A VALUcS 

225 

72.  f 

12 

3.8 

000 

1 

. 3 

001 

1 

. 3 

004 

2 

. 6 

005 

«> 

1.5 

01  0 

1 1 

3.5 

C2C 

5 

1.  5 

025 

7 

2.2 

030 

1 

. ? 

033 

1 

• 3 

03  5 

9 

2.e 

04C 

15 

4.F 

050 

1 

.?, 

06  0 

2 

.6 

C7C 

2 

.6 

CtiC 

2 

.6 

090 

2 

• O 

095 

6 

l.  € 

10C 

• 0 

AU  CTdtkj 

C.  OTHER 
! MEAN  » 18.9% 


FFcC'Jtr  LY  ? 


310 

TOTAL  • >: C J ' n s • * A 

3 10 

FFCCRCS  LEC1 

1 7 

l * T CO:.  CATA  VALUJ 

225 

72.  5 

42 

15.4 

COC 

1 

• 3 

001 

2 

• f 

005 

5 

1.  5 

C1C 

1 

• 3 

020 

3 

.5 

0?c 

3 

• 5 

C3C 

i 

.3 

0 i 3 

3 

.5 

040 

8 

2.S 

C5  0 

3 

t c 

06C 

1 

.3 

C7L 

1 

.3 

080 

1 

• 3 

OB'- 

1 

.3 

C55 

3 

• s 

100 

.0 

Al  L OTHERS 

In  general,  do  you  think  the  library  service  is  getting  better  or  worse 


FF'.CUENCY  T l-AT  A 


310  TOTAL  mlCQKDS  - AC 
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DEFINITELY  BETTER 1 9 2.6  1 
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DEFINITELY  WORSE 5 5 1.5  5 
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APPENDIX  A 


DATA  COLLECTION  METHODOLOGY 


The  Rand  Library  distributed  the  questionnaire  via  the  internal  mail 
service  to  all  439  members  of  the  professional  research  staff  on  February  24, 
1975.  The  listing  of  professional  staff  members  was  supplied  by  Personnel. 
Administrators,  editors,  librarians,  and  non-exempt  support  staff  were 
excluded  from  the  survey.  A letter  from  the  President  of  Rand,  Don  Rice, 
requesting  cooperation  from  the  research  staff  was  attached  as  a cover 
letter.  (See  Figure  A for  a copy  of  the  cover  letter.) 

By  March  7,  1975,  the  Library  had  received  back  59%  of  the  original  mail 
out  of  259  of  439  questionnaires.  The  first  follow  up  was  conducted  on 
March  11,  1975  by  general  announcement.  The  article  below  was  placed  in 
"Rand  Items,"  the  weekly  newsletter  which  is  circulated  to  all  personnel  at 
Rand. 


RAND  LIBRARY  EVALUATION  SURVEY 


"If  you  are  still  mulling  over  your  copy  of  the  Library  Evaluation 
Survey,  please  complete  and  return  it  to  the  Library  as  soon  as 
possible.  Over  60%  of  the  questionnaires,  distributed  February  24 
to  research  staff  members,  have  been  returned.  In  order  to  have 
as  complete  an  analysis  as  possible  of  the  research  staff's 
evaluation,  the  Library  would  appreciate  your  returning  the 
questionnaire  now  if  you  have  not  already  done  so." 

By  March  20,  the  breakdown  by  department  was  as  follows: 


Distributed 

Returned 

% of  Return 

Economics 

60 

44 

73.3% 

Engineering 

51 

35 

68.6% 

Information  Sciences 

81 

50 

61.7% 

Management  Sciences 

112 

77 

68.8% 

Physical  Sciences 

44 

26 

59.1% 

Rand  Computation  Center 

34 

16 

47.1% 

Social  Science 

46 

20 

43.5% 

Administration 

5 

5 

100.0% 

DPD 

6 

5 

83.3% 

Unmarked 

- 

1 

- 

Total 

439 

279 

63.6% 

The  first  follow  up  increased  the  response  rate  by  4.6%. 
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Figure  A 

MEM QRAND  UM 

February  20,  1975 


To: 

Research 

Staff 

From: 

Don  Rice 

A 

Subject: 

/ 

LIBRARY 

QUESTIONNAIRE 

The  Rand  Library  with  support  from  RCC  is  conducting  a survey  of  user  evaluation 
of  library  services.  The  purpose  of  this  study  is  to  provide  the  Library  with 
information  it  can  use  to  make  changes  and  improvements  in  its  services  and 
resources,  and  to  guide  it  in  the  development  of  future  new  services. 

Your  cooperation  in  answering  the  attached  questionnaire  is  important  to  this  study. 
The  questionnaire  is  designed  with  skip  pattern  questions  to  speed  you  along  and 
should  take  less  than  twenty  minutes  to  complete.  Please  return  the  completed 
questionnaire  to  the  Library  not  later  than  A.Aarch  7. 


On  March  20,  1975  a second  follow  up  utilizing  a different  method  was 
implemented.  An  announcement  was  made  during  a ROMEO  (Rand  Office  Manage- 
ment Evaluation  Committee)  meeting  regarding  the  return  of  the  questionnaire. 
The  following  excerpt  is  from  the  ROMEO  minutes: 

Library  Questionnaire 

"Cecily  indicated  that  about  64%  of  the  439  questionnaires 
distributed  had  been  returned.  Quite  a number  of  written 
comments  had  been  received  and  the  results  are  providing 
useful  information  and  some  excellent  suggestions.  The 
results  will  be  analyzed  via  computer.  Cecily  requested 
assistance  from  administrators  in  several  departments 
where  the  returns  were  slow  in  coming  in.  She  will  comment 
later  on  the  final  results  of  the  questionnaire." 

Following  the  meeting  administrative  assistants  in  the  departments  were 
also  contacted  and  asked  if  they  would  contact  researchers  who  had  not 
responded  to  the  questionnaire.  They  were  given  the  names  of  those  members 
of  the  research  staff. 

Not  quite  68%  of  the  questionnaires  had  been  returned  by  April  14. 


Distributed 

Returned 

% of  Return 

Economics 

60 

47 

78.3% 

Engineering 

51 

38 

74.5% 

Information  Sciences 

81 

52 

64.2% 

Management  Sciences 

112 

82 

73.2% 

Physical  Sciences 

44 

27 

61.4% 

Rand  Computation  Center 

34 

18 

52.9% 

Social  Science 

46 

22 

47.8% 

Administration 

5 

5 

100.0% 

DPD 

6 

5 

83.3% 

Unmarked 

- 

1 

- 

Total 

439 

297 

67.7% 

The  second  follow  up  increased  the  response  rate  by  4.1%. 

The  third  and  final  follow  up  was  conducted  on  April  15,  1975  in 
"Rand  Items." 


LIBRARY  QUESTIONNAIRE  DEADLINE 


"The  deadline  to  return  the  Library  questionnaire  is  Friday, 

April  25.  The  Library  is  eager  to  have  all  researchers  (both 
Library  users  and  non-users)  express  their  library  needs.  If 
you  have  lost  your  questionnaire  and  need  a replacement,  call 
Ext.  368." 

The  third  follow  up  increased  the  response  rate  an  additional  2.9% 
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The  final  return  totaled  310  questionnaires,  or  an  overall  70.6% 
return.  Final  breakdown  by  department  was  as  follows: 


Distributed 

Returned 

% of  Return 

Economics 

60 

49 

81.7% 

Engineering 

51 

38 

74.5% 

Information  Sciences 

81 

56 

69.1% 

Management  Sciences 

112 

87 

77.7% 

Physical  Sciences 

44 

28 

63.6  % 

Rand  Computation  Center 

34 

18 

52.9% 

Social  Science 

46 

23 

50.0% 

Administration 

5 

5 

100.0% 

DPD 

6 

5 

83.3% 

Unmarked 

- 

1 

- 

Total 

439 

310 

70.6% 

The  total  number  of  respondents  for  the  Rand  Library  Evaluation  Survey 
was  310,  a response  rate  of  70.6%.  Users  of  this  codebook  should  note  that 
the  marginals  give  the  distribution  of  response  for  only  the  file  of 
completed  and  returned  questionnaires  (n=310) . These  responses  are  therefore 
unweighted.  The  potential  non-response  bias  can  be  evaluated  in  part  by 
examining  Table  10.0,  "Response/Non-Response  by  Department  Classification" 
and  Table  11.0,  "Response/Non-Response  by  Job  Classification."  Economics 
and  Management  Sciences  Departments  are  slightly  overrepresented  and  the 
Computer  Services  Department  (then  RCC)  and  the  Social  Science  Department 
are  slightly  underrepresented  in  the  file.  The  discrepancy  between  Personnel's 
record  of  department  assignment  and  the  individual  respondent's  perceived 
department  classification  is  probably  minimal.  A slight  non-response  depart- 
mental bias  is  apparent  but  potentially  unrelated  to  variables  of  interest 
because  of  departmental  heterogeneity. 

For  job  classification,  assignment  errors  occur  and  the  comparison  and 
interpretation  are  more  difficult.  Respondents  do  not  necessarily  feel 
bound  by  the  personnel  classifications  reflected  in  the  instrument  and  in 
addition,  change  their  choice  of  job  classification  as  their  particular  job 
responsibilities  change  and  identities  are  modified.  Allowing  for  classifica- 
tion errors,  no  startling  differences  between  theoretical  and  actual 
distributions  occur,  and  social  scientists  still  are  underrepresented  while 


Table  10.0 

RESPONSE/NON-RESPONSE  BY  DEPARTMENT  CLASSIFICATION 


1.4 

10.0 

13.7 


11.6 

7.7 

18.5 

10.5 

25.5 


310 


Job  Classification 
Listed  in 
Questionnaire 


Actual  Response 
(How  Respondent  Perceived 
Department  Classification) 
Frequency  % 


Theoretical  Response 
(Personnel 

Department  Cl a s s i f ication) 
Frequency 


5 
0 

6 
44 
60 

0 

51 

34 

81 

46 

112 

0 


Table  11.0 

RESPONSE/NON-RESPONSE  BY  JOB  CLASSIFICATION 


1 


JOB  CLASSIFICATION  LISTED 
IN  QUESTIONNAIRE 


ADMINISTRATION 
COST  ENGINEER 
ECONOMIST 
ENGINEER 

LOGISTICS  SPECIALIST 
MATHEMATICIAN 

SYSTEMS  INFORMATION  SPECIALIST' 
OPERATIONS  RESEARCH  SPECIALIST 
PHYSICAL  SCIENTIST 
PROGRAMMER  ANALYST 
PSYCHOLOGIST 
SOCIAL  SCIENTIST 
COMPUTER  SCIENTIST 
OTHER  (SPECIFY)3 
NO  RESPONSE4 

TOTALS 


Actual  Response 
(HOW  RESPONDENT  PERCEIVED 
JOB  CLASSIFICATION) 

Frequency 

% 

13 

4.2 

10 

3.2 

53 

17.1 

34 

11 

2 

.7 

26 

8.4 

6 

1.9 

23 

7.4 

29 

9.4 

41 

13.2 

3 

1.0 

38 

12.3 

13 

4.2 

16 

5.2 

3 

1.0 

310 

100% 

Theoretical  Response 
(PERSONNEL  JOB 
CLASSIFICATION) 
Frequency  I % 


One  individual  classified  as  an  administrator  by  personnel  requested  the 
questionnaire.  Otherwise  administrators,  editors  and  librarians  were  not  on  the 
distribution  list  which  was  restricted  to  professional  research  staff  members.  Those 
who  responded  "Administration"  were  often  department  heads,  program  managers,  etc.  who 
are  not  classified  by  personnel  as  "administration." 

2 

Although  six  respondents  indicated  this  job  classification,  personnel  did  not 
list  it  as  a classification  in  1975.  Other  respondents  corrected  the  job  title  to 
"Information  Systems  Scientist"  which  personnel  does  list  with  13  individuals. 

3 

Respondents  wrote  in  the  following:  RGI-researcher ; information  systems  scientist 

(2);  research  programmer;  senior  staff  member;  statistician  (3);  natural  scientist; 
military  analyst  (2);  systems  programmer;  MD;  research  assistant;  consultant  to  health 
program;  site  director.  Personnel  listed  3 job  classification  other  than  those  on  the 
questionnaire:  information  systems  scientists  (13);  research  programmers  (10);  natural 

scientist  (1). 

4 

One  respondent  tore  the  front  page  from  his  questionnaire;  two  listed  themselves 
as  "assistant  professionals"  and  did  not  indicate  a job  classification. 


economists  are  slightly  overrepresented.  For  the  mathematicians  and  operations 
research  specialist,  the  differences  are  probably  due  to  classification  per- 
ception differences. 


The  non-response  bias  probably  does  not  significantly  affect  the 
marginals.  From  another  point  of  view,  the  library  primarily  serves  its 
users  and  especially  those  users  with  a vested  interest  in  the  library 
policies.  For  the  non-respondents  the  library  can  be  considered  a non-salient 
issue. 
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APPENDIX  B 


CLEANING  PROCESS 


The  marginals  in  the  codebook  represent  the  data  values  exactly  as 
they  exist  on  the  edited  machine  readable  file  of  survey  data.  This  data 
file  is  basically  a computer  image  of  the  respondent's  answer  recorded  in 
the  questionnaire.  The  data  values  on  this  edited  file,  however,  differ  in 
certain  documented  ways  from  the  original  unedited  hardcopy.  Sometimes  the 
respondent  responded  inconsistently,  failed  to  follow  the  skip  instructions, 
omitted  questions  and/or  otherwise  responded  outside  the  structure  of  the 
instrument.  In  addition,  some  responses  were  unintelligible  (i.e.,  two 
responses  for  a single  item  or  an  unreadable  response) . In  order  to  improve 
both  the  quality  of  the  data  as  well  as  reduce  the  hardcopy  questionnaire 
responses  to  a machine  readable  file,  an  operation  called  "data  cleaning" 
was  performed  by  the  Survey  Data  Preparation  group  of  the  Computer  Services 
Department . 

The  survey  data  preparation  cycle  is  both  linear  and  iterative.  For  the 
Library  survey  the  questionnaires  were  received  from  the  library  SDP's  data 
control.  After  being  inventoried,  labeled,  logged,  and  filed  the  materials 
formally  entered  the  processing  cycle.  First,  the  questionnaires  received 
a prekeypunch  edit  to  insure  that  the  document  could  be  directly  keypunched. 
When  the  prekeypunch  edit  was  completed,  the  documents  were  transferred  to 
data  entry  for  the  keying  of  the  data  onto  computer  tapes.  The  computer 
readable  files  as  they  come  from  data  entry  were  then  passed  through  a 
computerized  cleaning  program  that  checked  the  data  for  range  and  logic 
errors.  When  data  did  not  conform  to  the  cleaning  specifications,  an  error 
report  listing  was  produced.  These  error  report  listings  were  examined  and 
evaluated  by  the  editing  staff  to  determine  the  nature  of  the  error  and  the 
appropriate  method  of  resolution.  Eventually,  the  error  reports  were  resolved 
by  correcting  or  modifying  the  data;  ignoring  the  error  message  and  over- 
riding the  cleaning  specification  for  the  particular  case;  or  overriding  the 
cleaning  specification  and  flagging  the  data  value  as  suspicious. 

When  a case  passed  all  the  prescribed  range  and  logic  checks,  it  was 
declared  "clean"  and  added  to  the  accumulating  clean  master  file.  The  "dirty" 
cases  were  cycled  in  an  iterative  process  until  all  were  declared  "clean." 
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The  accumulation  of  "clean"  cases  was  then  passed  against  the  final  version 
of  the  cleaning  specifications  and  declared  a master  clean  file.  This 
edited  data  file,  the  final  version  of  the  machine  readable  cleaning 
specifications,  a record  of  all  corrections,  updates  and  overrides,  and 
a listing  of  all  suspicious  data  values  were  then  ordered  in  a transaction 
file  for  later  use. 

The  data  entry  instructions  for  the  library  questionnaire  were  as 
follows : 

1.  Punch  as  shown. 

2.  Punch  "I"  in  fields  that  cannot  be  read. 

3.  All  fields  that  are  blank  are  to  be  punched  as  blanks. 

4.  Right  justify,  and  zero  fill  "written"  number  fields. 

The  following  questions  are  the  ones  involved: 

a.  Question  # 4 — Years,  Months. 

b.  Questions  #5:A,  # 5:B,  #5:C  — percent. 

c.  Question  #29  — percent. 

d.  Questions  #31:A,  #31:B,  # 31:C  — percent. 

5.  Columns  "77-78/"  will  be  "blank"  or  "22"  only. 

6.  Precede  responses  to  questions  #1  and  #2  with  zeros. 

The  new  keypunched  file  with  the  exception  of  any  data  entry  transcription 
errors,  formatting  conventions  and/or  "illegible"  response  fields  corresponds 
directly  to  the  hardcopy  questionnaire  it  represents. 

The  cleaning  process  was  designed  to  resolve  three  basic  types  of 
problems:  data  entry  and  reduction  errors,  respondent  data  inconsistencies, 

and  non-data  occurrences.  The  resolution  of  transcription  or  cleaning  errors 
and  non-data  occurrences  were  clerical  tasks,  but  respondent  data  inconsis- 
tencies presented  situations  of  conflicting  considerations  of  data  quality, 
data  integrity  and  interpretative  bias. 

The  cleaning  programs  identified  208  dirty  cases  which  produced  a total 
of  548  error  messages  (141  range  and  407  logic).  These  error  messages 
reflected  both  inappropriate  data  values  (i.e.  blanks  when  a question  should 
have  been  answered)  and  inconsistent  data  values  based  on  a previously 
selected  response.  Whenever  an  editor  was  confident  of  the  nature  of  the 
error,  and  the  resolution  was  consistent  with  other  data  in  the  questionnaire, 
extra  data  produced  when  the  respondent  incorrectly  followed  skip  pattern 

I | 

* 

if 
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instructions  was  deleted  and/or  pointer/trigger  question  responses  were 
modified.  When  in  doubt,  the  response  was  not  altered.  Double  responses 
were  treated  as  missing  data  since  it  was  usually  impossible  to  be  confident 
of  the  correct  value.  Missing  data  was  coded  zero  when  the  respondent 
should  not  have  omitted  the  question  and  left  blank  when  the  skip  was 
appropriate.  The  editing  process  was  executed  in  a conservative  manner 
with  regards  to  the  updating  of  respondent  given  data. 

Upon  the  completion  of  cleaning,  the  marginals  were  run  utilizing  the 
"edited"  or  master  clean  file. 


I 


